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PATENT 
KIK01 P323 

METHOD AND APPARATUS FOR DIRECT IMAGE PICK-UP OF GRANULAR 
SPECK PATTERN GENERATED BY REFLECTING LIGHT OF LASER BEAM 

BACKGROUND OF THE INVENTION 

Field of the Invention 

[0001] The present invention relates to a method and an apparatus for direct image pick-up of a 

granular speck pattern generated by reflecting and/or transmitted light of a laser with which an 
opaque, translucent or transparent object to be inspected is irradiated. 
[0002] The present invention is based on the fact that the reflected and/or transmitted light in 

such granular speck pattern is generated as the object to be inspected is irradiated with a laser 
beam. This phenomenon will be discussed with respect to the case of the reflected light in the 
granular speck pattern. The granular speak pattern appears over an entire reflection surface to 
5 be inspected as it is irradiated with a monochromatic laser beam of high directivity, luminance 
C\ and linearity. The granular speck pattern has the maximum within an angle of reflection at an 
W incidence spot of said laser beam and gradually decreases toward the peripheral edge. In the 
J: case of the transmitted light also, such granular speck pattern appears over the entire 
transmission surface . 

j]S003] This granular speck pattern depends on the degree of roughness on the surface of the 

S object to be inspected or shapes of fine ingredients forming the object to be inspected. The 
% granular speck pattern as the object to be inspected moves and the same pattern is reproduced 
^ so far as no change occurs in the spot on the object to be inspected at which said object is 
irradiated with the laser beam, the wavelength of the laser beam and the beam diameter. The 
granular specks have their sizes reduced or magnified depending on a particular pattern of the 
object to be inspected at the particular laser irradiated spot thereon and the granular specks 
have their sizes magnified or reduced as the diameter of the laser beam is reduced or enlarged 
as the object to be inspected moves back or forth. 
[0004] The granular speck pattern is generated depending on a roughness of the surface of the 

object to be inspected. This granular speck pattern can be picked up not only when the object 
is made of metal, rubber, wood etc., but also when the object is a mirror surface finished IC 
wafer or glass having a high transparency, both of which present the highest smoothness. 



[0005] In this manner, the granular speck pattern may be picked up as an index to observe 

changes of various conditions, for example, a quantity of movement, displacement, 
deformation, coagulation, melting or progress of rust in a non-contact fashion without demand 
for any specified index or mark. 

Description of the Related Art 
[0006] Usually a darkroom has been used as the measurement environment to pick up the 

granular speck pattern and reflecting light or transmitted light of the laser beam has been 

projected on a screen made of frosted glass. A pattern projected on the screen has then been 

indirectly picked up by a digital or video camera. 
[0007] So-called cross correlation method is also well known in which the object is irradiated 

with laser beam oriented vertically to the object and there are provided a pair of 

unidimensional sensors at an angle of 45° about the normal line, respectively, and a difference 
'f* between photoelectric outputs of these unidimensional sensors is used to measure a distortion. 
- However, direct observation of such distortion in the form of an image is impossible and any 
% effective measurement is impossible for this method for the object moving back and forth. 
[db08] Said indirect image pick-up method has usually been carried out in a darkroom 

N According to said cross correlation method, the variation in light intensity has been directly 
S converted to the corresponding variation in voltage and therefore it has been impossible to 
£ visually recognize the image picked up. In addition, this cross correlation method is not 

effective at all for the object moving back and forth since the irradiation laser beam cannot be 

focussed into a single spot. 

SUMMARY OF THE INVENTION 

[0009] The present invention aims to eliminate the above described restrictions as well as many 

requirements imposed on the prior art due to the designing technique as well as the measuring 
environment. To meet this, the present invention aims to simplify respective means in the 
method and apparatus for measurement, on one hand, and to alleviate restrictions imposed on 
the object to be inspected, on the other hand. 

[0010] The object set forth above is achieved, according to a first aspect of the present 

invention, by method and apparatus for allowing said direct image pick-up using the 
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commercially available digital or video camera by depriving the camera of its image forming 
lens. 

The object set forth above is achieved, according to a second aspect of the present 
invention, by method and apparatus allowing said direct image pick-up in a well lighted 
environment like an ordinary office merely by providing in front of the CCD element, a 
shielding tube (e.g., the shielding tube having a circular cross section) adapted to shield 
extraneous light rays such as illuminating right coming from indoor luminaries or sunlight 
coming through windows. 



Operation 

[0012] The present invention generally comprises five features. 

[0013] A first feature is to irradiate an object to be inspected with laser beam. 

[2)14] A second feature is to pick-up a granular speck pattern in a direct manner. 

|ftl5] A third element is to carry out the image pick-up in a well lighted environment like an 

W ordinary office. 

i!016] A fourth feature is to quantitatively correlate movement, shift, deformation, coagulating 

^ rate or melting rate of the object or progress of rusting on the object with movement of the 
t picked-up granular speck pattern and thereby to use this quantitative correlation for a specific 
Q machine or apparatus. 

f|oi7] A fifth feature is to quantitatively calculate movement, shift or deformation of the 

P picked-up granular speck pattern on the basis of a pixel interval of the CCD element or to 
compare the immediately previous image of picked-up granular speck pattern with the 
immediately subsequent image of picked-up granular speck pattern to calculate a coagulating 
rate, a melting rate or progress of rusting so that the result of calculation may be displayed 
depending on the particular purpose of every machine or apparatus. 
[0018] These features will be summarized in combination with one another. The object to be 

inspected is irradiated with the laser beam to generate the granular speck pattern depending on 
a degree of roughness of said object to be inspected or shapes of fine ingredients constituting 
said object to be inspected. In this way, the image of the granular speck pattern, depending on 
movement, shift or deformation, is continuously picked up. A center of gravity of a speck 
selected as a reference point in the granular speck pattern is tracked in a time series fashion so 
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that a quantity of movement is real-time calculated on the basis of the pixel interval or the 
memory address real time displayed. 
[0019] If a quantity of the object to be inspected is relative large, immediately before said 

center of gravity of the selected granular speck as the reference point departs from the view 
field of the CCD element, a center of gravity of another granular speck still lying within said 
view field may be selected as a new reference point. Such renewal of the reference point may 
be repeated to achieve a continuous measurement. 
[0020] As for the back and forth movement of the object to be inspected, the granular speck 

pattern has its entire area proportionally reduced as the object to be inspected gets nearer to the 
CCD element while the granular speck pattern has its entire area proportionally enlarged. On 
the basis of this area ratio, a quantity of the back and forth movement of the object to be 
inspected is calculated and displayed. 
[j)21] A quantity of the back and forth may be also calculated by selecting two granular 

S specks from the granular speck pattern and by detemiining a variation in a distance in straight 
W line between respective centers of gravity of these two granular specks. 
[0022] The coagulating rate, melting rate or progress of rusting can be determined by 

y comparing the immediately previous image with immediately subsequent image of the 
!f continuously picked-up granular speck patterns on the basis of a degree of coincidence between 
O these two images. 

M RKTF.F DESCRIPTION OF THE DRAWINGS 

[0023] Fig. 1 is a diagram illustrating a method for direct image pick-up of a granular speck 

pattern generated by laser beam reflected on an opaque object to be inspected; and 
[0024] Fig. 2 is a diagram similar to Fig. 1 but illustrating a granular speck pattern generated 

by laser beam reflected on a transparent or translucent object to be inspected. 

r>F T ATT FD DFSCKTPTTON OF THE P REFERRED FMBODTMENTS 
[0025] Before a preferred embodiment of this invention is described in reference with Figs. 1 

and 2 of the accompanying drawings, details of an object to be inspected and of respective 
components' types as well as functions will be described. 
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[0026] Respective reference numerals designate elements as following: 1 object to be 

inspected; la blood; 2 laser projector; 3 laser beam; 4 laser beam irradiated spot; 5 image pick- 
up device; 6 CCD element; 7 shielding tube adapted to shield extraneous light around granular 
speck pattern; 8 view field of CCD element; 9 granular pattern generated by reflected light; 9a 
pattern generated by transmitted light; 10 frosted glass on which transmitted light is projected 
within darkroom according to conventional method for indirect image pick-up; 10a frosted 
glass on which transmitted light is projected within a darkroom according to conventional 
methods for indirect image pick-up; 11 granular speck pattern generated by reflected light; 11a 
granular speck pattern generated by transmitted light; 12 monitoring device for display of 
picked-up granular speck pattern; 13 video signal brancher for picked-up video signal in 
granular speck pattern imaged granular speck pattern; 14 A/D (Analog/Digital) converter 
adapted to digitalize video signals in the form of analog signal before input to computer; 15 
'% processing unit adapted to, depending on particular purpose of application, calculate quantity 
S of movement, deformation or displacement of granular specks or granular speck pattern and 
y thereby to calculate coagulating or melting rate on the basis of coinciding degree between 
S immediately previous image and immediately subsequent image; 16 display device adapted to 
^ display various quantities or rates calculated by processing unit in the form of numerical value 
H or graphic chart; and 17 a slide glass used for process based on transmitted light. 
|t)27] Fig. 1 is a diagram illustrating method and apparatus according to Claims 1 and 2, 

^ respectively, for direct image pick-up of a granular speck pattern generated by laser beam 

reflected on an opaque object to be measure. 
[0028] An object 1 to be inspected is irradiated with laser beam 3 from a laser projector 2. In 

the case of a sheet copper as an example of the object 1, a granular speck pattern 11 is 
generated on the entire surface of the object 1 as said object 1 is irradiated at a target spot 4 
thereon with the laser beam 3. It should be understood that such granular speck pattern 11 
cannot be visually recognized directly. 
[0029] When the measurement is carried out in a darkroom, the granular speck pattern 11 is 

projected on a frosted glass plate 10 placed on an optical path as seen in Fig. 1. 
Conventionally, the granular speck pattern 11 projected in this manner has been picked up 
using a digital or other video camera. 
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[0030] According to the present invention, an image pick-up device 5 corresponding to said 

digital or video camera deprived of its image forming lens (i.e. , the lens is removed to define a 
lensless video camera) is incorporated with a CCD element 6. Said image pick-up device 5 is 
provided on its front side, i.e., in front of said CCD element 6, with a shielding tube 7 serving 
to shield any extraneous light due to an indoor illuminating light. The shielding tube 7 is 
slightly larger than the CCD element 6, more specifically, has a length of several centimeters 
and a circular or square cross section. This arrangement enables the granular speck pattern 1 1 
to be directly picked up. A scope (i.e. , area) of the image picked up by the CCD element 6 is 
defined by a view field 8. 

[0031] A video signal based on the picked-up image is branched in two by a video signal 

brancher 13, one of which is input to a monitor device 12 which then displays a particular 
image of the granular speck pattern 11 given by said one of the branched signals. 
[(S?32] The other of said branched video signals is input to an A/D converter 14 in the form of 

*0 an analog signal and converted by said A/D converter 14 to the corresponding digital signal to 
r be input to a processing unit 15. The unit 15 carries out a desired processing and a result of 
"~ this processing is input to a display device 16 which displays said result in the form of a 
% i numerical value or graphic chart. 

[p033] More specifically, the granular speck pattern 11 moves in parallel to the object to be 

% measure as said object 1 moves. In view of this, the quantity of movement is calculated on the 
MS basis of a pixel interval in the CCD element 6 and not only quantity but also a speed as well as 
:U: a direction of movement are displayed. 

[0034] As for coating or adhesive, each pair of immediately previous and immediate 

subsequent images in continuously picked-up granular speck patterns are successively 
compared to each other to calculate a coinciding degree so that drying rate or hardening rate 
obtained on the basis of said coinciding degree may be displayed. After coating has been dried 
or adhesive has been hardened, the picked-up image remains identical with the coinciding 
degree of 100%. 

[0035] In the case of thermally meltable solder, the picked-up image remains constant with a 

coinciding percentage of 100% before heated, and the coinciding percentage gradually 
decreases down to 0% as the solder begins to be heated until the solder is liquidized. This is 
also true for progress of rusting. 
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[0036] An average area of the granular speck pattern 11 and an area of the individual granular 
speck 9 are proportionally enlarged as the object to be inspected recedes from the image pick- 
up device 5 and proportionally reduced as said object gets nearer to said image pick-up device 
5. Such phenomenon may be utilized to determine a distance from the image pick-up device 5 
to the object to be inspected. 

[0037] Fig. 2 is a diagram illustrating a method for direct pick-up of the granular speck pattern 

generated by transmitted light of the laser beam when the object to be inspected using a 
shielded direct view CCD is transparent or translucent. 

[0038] An object 1 to be inspected is irradiated with laser beam 3 from a laser projector 2. It 

is assumed here that blood la is the object to be inspected and has been dropped on slide glass 
17. Irradiation of the object la at the spot 4 with the laser beam 3 causes a granular speck 
pattern 11 and a granular speck pattern 11a to be generated by reflected light and transmitted 

C light, respectively, of the laser beam 3 on entire surface of the object 11a. It should be 

C= understood that these granular speck patterns 11, 11a cannot be visually recognized by an 

. jl operator. 

10039] When the measurement is carried out in a darkroom, the granular speck pattern 11 and 

M the granular speck pattern 11a are projected on frosted glass plates 10, 10a, respectively, as 
y, seen in Fig. 2. Conventionally, the granular speck patterns 11, 11a projected in this manner 
tf have been picked up. 

[8040] According to the present invention, an image pick-up device 5 corresponding to said 

£ digital or video camera deprived of its image forming lens includes a CCD element 6. Said 
image pick-up device 5 is provided on its front side, i.e. , in front of said CCD element 6, with 
a shielding tube 7 serving to shield any extraneous light due to an indoor illuminating light. 
The shielding tube 7 is slightly larger than the CCD element 6, more specifically, has a length 
of several centimeters and a circular or square cross section. This arrangement enables the 
granular speck pattern 11 to be directly picked up. A scope of the image picked up by the 
CCD element 6 is defined by a view field 8. 
[0041] A video signal based on the picked-up image is branched in two by a video signal 

brancher 13, one of which is input to a monitor device 12 which then displays a particular 
image of the granular speck pattern 11 given by said one of the branched signals. 
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[0042] The other of said branched video signals is input to an A/D converter 14 in the form of 

an analog signal and converted by said A/D converter 14 to the corresponding digital signal to 
be input to a processing unit 15. The unit 15 carries out a desired processing and a result of 
this processing is input to a display device 16 which displays said result in the form of a 
numerical value or graphic chart. 

[0043] When the method according to the invention relies upon the transmitted light of laser 

beam, the granular speck pattern 11 generated by the reflecting light of laser beam presents the 
same nature as that of the granular speck pattern 11 obtained when the method relies upon the 
reflecting light of laser beam as illustrated by Fig. 1. 

[0044] For the blood sample la to be inspected by the method relying on the transmitted light, 

the laser beam is diffusively reflected on erythrocytes to generate the granular speck pattern 
11a since the beam from the laser beam projector 2 has a wavelength in the order of 700 nm. 

s % In other words, this granular speck pattern 1 la is based on movement of the erythrocytes in the 

O blood sample. 

|®45] The granular speck pattern 11 generated by the reflecting light depends on a surface 

V"; condition of the blood sample la while the granular speck pattern 11a generated by the 
? %t transmitted light depends on an interior condition of the blood sample la. 

IS 

P046] To determine, for example, a blood coagulation time, the surface of the blood sample 

S dropped on the slide glass 17 is irradiated with the laser beam 3 to obtain the granular speck 
C pattern 11 generated by the reflecting light and the granular speck pattern 11a generated by the 
y- transmitted light. 

[0047] The granular speck pattern 11a generated by the transmitted light is remarkably 

unstable at the beginning but gradually stabilized as the blood coagulation progresses until the 
pattern 11a is completely stabilized, suggesting completion of the blood coagulation. In this 
way, the blood coagulation time can be determined in non-contact fashion. Similarly, 
hardening or drying of translucent adhesive or coating can be observed. 

Effect of the Invention 

[0048] As will be apparent from the foregoing description, the method according to the 

invention enables the granular speck pattern to be directly detected using a digital or other 
video camera deprived of its image forming lens. By providing a shielding tube adapted to 
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shield any extraneous light in front of the CCD element incorporated therein with the direct 
image pick-up can be easily achieved even in a well lighted environment like an ordinary 
office. In this manner, movement, deformation, shift of the object to be inspected as well as 
coagulation, melting or progress of rusting in the object such as a sample of adhesive, metal or 
blood can be easily and quantitatively determined. 
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